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Houghton Mifflin Mathematics 



Program description 



Houghton Mifflin Mathematics is a core curriculum for kindergarten 
through grade 6 students at all ability levels. According to its devel- 
oper, Houghton Miffiin Mathematics emphasizes the five content 
strands and processes recommended by the National Council of 
Teachers of Mathematics Standards. At each grade level the pro- 
gram focuses on basic skills development, problem solving, and 



vocabulary expansion to help students master key math concepts. 
The program incorporates assessments — including lesson-level 
interventions to meet the needs of all learners — to monitor stu- 
dents’ progress. Students practice daily math lessons through 
instructional software, enrichment worksheets, manipulatives, 
and workbooks in addition to student textbooks. 



Research Two studies of Houghton Miffiin Mathematics met What Works 
Clearinghouse (WWC) evidence standards with reserva- 
tions. The two studies included students in grades 2-5 from 
a range of socioeconomic backgrounds, racial groups, and 



math performance levels. Students came from more than 800 
schools in urban, suburban, and rural communities in California, 
Illinois, Missouri, Wisconsin, New Jersey, New York, and South 
Carolina. 1 



Effectiveness Houghton Miffiin Mathematics was found to have no discernible effects on mathematics achievement. 

Mathematics achievement 
Rating of effectiveness No discernible effects 
Improvement index 2 Average: +5 percentile points 

Range: -5 to +12 percentile points 



1. The evidence presented in this report is based on available research. Findings and conclusions may change as new research becomes available. 

2. These numbers show the average and range of improvement indices for all findings across the studies. All estimates of the improvement index across 
mathematics achievement outcome measures at different grade levels are positive except for a single -5 value. 
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Developer and contact 

Developed by Houghton Mifflin School Division, a division of the 
Houghton Mifflin Company, 222 Berkeley Street, Boston, MA 
02116. Web: www.hmco.com . Telephone: (617) 351-5000. 

Scope of use 

The edition of Houghton Mifflin Mathematics reviewed in this 
report was published in 2002. Information is not available on the 
number or demographics of students, schools, or districts using 
this program. 

Teaching 

Houghton Mifflin Mathematics provides three-step teaching 
plans for every lesson. Lessons start with an introduction 
or teaching step. Teachers then conduct a guided practice 
session, which is followed by independent student practice. 
The lessons end with a brief assessment and summary. Ongo- 
ing assessment is incorporated into the program to monitor 
students’ progress. Mathematical content at each grade level 
is divided into topical units. The number of units for each 
school year ranges from 7 to 13, depending on the grade and 



topics covered. Each unit consists of 2-4 lessons, usually cor- 
responding to a specific chapter in the student textbook. The 
developer offers professional development to school districts 
adopting the curriculum and additional teaching resources on 
its website. 

Cost 

Houghton Mifflin Mathematics® 2002 provides a range of 
individually priced classroom materials that vary by grade level 
and material type. Student textbooks come in single or multiple 
volumes and range in cost from $22.11 (grade K) to $56.46 
(grades 3-6). Assessment guides for grades 1-6 are $93.24. 
Houghton Mifflin Mathematics® 2002 normally provides a free 
teaching edition upon adoption of the curriculum. Prices for the 
Teacher’s Edition, if purchased, range from $147.27 to $195.12, 
depending on grade level. Other Houghton Mifflin Mathematics® 
2002 classroom materials include individual student manipulative 
kits ($16.98-$19.98), teacher resource book ($33.87), homework 
and practice workbooks ($8.58), spiral review blackline masters 
($29.46), lesson planner CD-ROM ($70.11), test preparation trans- 
parencies ($51.48), and the Test Generator CD-ROM ($121.50). 



Four studies reviewed by the WWC investigated the effects of 
the Houghton Mifflin Mathematics program. Two studies were 
quasi-experimental designs that met WWC evidence standards 
with reservations. The two remaining studies did not meet WWC 
evidence screens. 

Johnson and Hall (2003) included 160 intervention schools 
in eight California districts using Houghton Mifflin Mathematics 
(2002 edition) in grades 2-5 and 137 comparison schools in 
eight different districts using non-Houghton Mifflin programs. 
The intervention schools had completed their first year of imple- 
menting Houghton Mifflin Mathematics. The comparison school 
districts were matched to the intervention districts based on 
prior mathematics achievement scores on California’s Stanford 
9 test, student demographic characteristics, and district sizes. 
Selection of comparison school districts relied on data from 



the California Department of Education, the Guality Education 
Database, and the American Institutes for Research. Statistical 
analyses of the math scores for the intervention districts and 
the comparison districts collected during the baseline year 
(2000-01) showed that, prior to the introduction of Houghton 
Mifflin Mathematics, there were no statistically significant differ- 
ences between the two groups of schools at any grade level. 

The EDSTAR, Inc. (2004) study was conducted in 519 schools 
from 32 school districts (16 district pairs) in California, Illinois, 
Missouri, Wisconsin, New Jersey, New York, and South Carolina. 
The intervention group included 308 schools from 16 districts 
using Houghton Mifflin Mathematics (2002 edition) for the first 
time during the 2002-03 school year. The comparison group 
included 211 schools from 16 different districts using reform, 
traditional, or balanced math programs. Math programs were 
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classified as reform if they placed more emphasis on conceptual 
understanding than on traditional computation skills. Traditional 
programs emphasized computational skills, while balanced 
programs integrated conceptual understanding with traditional 
computational skills. 

In each of the 16 district pairs in the EDSTAR, Inc. (2004) 
study, the intervention and comparison districts were matched 
based on prior mathematics achievement scores for the 
baseline year (2001-02), student demographics, district size, 
and average school size. No statistically significant differences 
in math achievement scores for the baseline year were found 
between the intervention and comparison groups. The WWC 
determined that having one district in the intervention group 
and a separate district in the comparison group confounded 
the intervention effect with the district. 3 The intervention effect 



could not be disentangled from other district characteristics 
without limiting the study to states that had multiple districts 
in the intervention and comparison groups. The authors 
provided additional information that enabled the district data 
to be separated by state. The WWC analyses are based on the 
reduced sample of three states, eight district pairs (16 districts), 
and 212 schools. The three states in the reduced sample were 
California, South Carolina, and New Jersey. California had two 
district pairs (four districts) and 68 schools. South Carolina had 
four district pairs (eight districts) and 128 schools. And New 
Jersey had two district pairs (four districts) and 16 schools. In 
the reduced sample all of the comparison districts within a state 
used the same type of math program (reform, traditional, or 
balanced). 



Findings 

The WWC review of elementary school mathematics curriculum- 
based interventions addresses student outcomes in mathemat- 
ics achievement. 

Mathematics achievement. Johnson and Hall (2003) reported 
significant, positive effects for Houghton Mifflin Mathematics 
on overall mathematics achievement for grades 2-5. Because 
the authors presented average school-level math achievement 
gains and pretest scores but no posttest scores, the WWC 
requested school-level average posttest scores from the 
authors. 4 Using the school-level data provided by the authors, 
and after accounting for clustering, 5 the WWC determined that 



the effect of Houghton Mifflin Mathematics on math achievement 
was neither statistically significant nor substantively important, 
according to WWC criteria. Thus the WWC categorized the 
effect of Houghton Mifflin Mathematics on mathematics achieve- 
ment as indeterminate. 

The EDSTAR, Inc. (2004) study used a series of comparisons 
between a single treatment district and a single comparison dis- 
trict. This analysis does not allow the effect of the intervention 
to be disentangled from the effect of other district characteris- 
tics. As a result, the WWC requested that the authors aggregate 
the data in each of the three states that included multiple 
treatment districts and multiple comparison districts. 6 This 



3. For more information see the WWC Technical Paper on Teacher-Intervention Confound . 

4. For details about the information the WWC uses for its calculations, see Technical Details of WWC-Conducted Computations . 

5. The level of statistical significance was reported by the study authors or, where necessary, calculated by the WWC to correct for clustering within 
classrooms or schools and for multiple comparisons. For an explanation, see the WWC Tutorial on Mismatch . See Technical Details of WWC-Conducted 
Computations for the formulas the WWC used to calculate the statistical significance. In the case of Houghton Mifflin Mathematics, a correction for cluster- 
ing was needed. 

6. This analysis focuses on data where there was more than one district pair per state and, within the state, more than one district pair per type of compari- 
son condition. For example, two California district pairs had comparison districts that used the balanced curriculum, so those district pairs were included 
in the analysis. But only one district pair in California had a comparison district using the reform curriculum, so the intervention and comparison districts in 
that pair were excluded from analysis. The reduced sample did not include any comparison districts using a traditional math curriculum. 
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reanalysis eliminated the confound between intervention effects 
and district effects. Using school-level data provided to the 
WWC by the authors for the three states that had multiple dis- 
tricts in the intervention and comparison groups and accounting 
for clustering, 5 the WWC determined that the effect of Houghton 
Mifflin Mathematics on mathematics achievement was neither 
statistically significant nor substantively important, according 
to WWC criteria. Thus the WWC categorized the effect of 
Houghton Mifflin Mathematics on mathematics achievement as 
indeterminate. 



Rating of effectiveness 

The WWC rates the effects of an intervention in a given outcome 
domain as positive, potentially positive, mixed, no discernible 
effects, potentially negative, or negative. The rating of effective- 
ness takes into account four factors: the quality of the research 
design, the statistical significance of the findings (as calculated 
by the WWC 5 ), the size of the difference between participants in 
the intervention condition and the comparison condition, and the 
consistency in findings across studies (see the WWC Interven- 
tion Rating Scheme) . The WWC found Houghton Miffin to have 
no discernible effects for mathematics achievement. 



The WWC found Houghton 
Mifflin Mathematics to have 
no discernible effects for 
mathematics achievement 



Improvement index 

The WWC computes an improvement index for each individual 
finding. In addition, within each outcome domain, the WWC 
computes an average improvement index for each study and an 
average improvement index across studies (see Technical Details 
of WWC-Conducted Computations) . The improvement index rep- 
resents the difference between the percentile rank of the average 
student in the intervention condition versus the percentile rank of 
the average student in the comparison condition. Unlike the rating 
of effectiveness, the improvement index is entirely based on the 
size of the effect, regardless of the statistical significance of the 
effect, the study design, or the analysis. The improvement index 



can take on values between -50 and +50, with positive numbers 
denoting favorable results. The average improvement index for 
mathematics achievement is +5 percentile points across the two 
studies, with a range of -5 to +12 percentile points across findings. 

Summary 

The WWC reviewed four studies on Houghton Mifflin Mathemat- 
ics. Two studies met WWC evidence standards with reservations; 
the remaining studies did not meet WWC evidence screens. 
Based on these two studies, the WWC found no discernible 
effects on mathematics achievement. The evidence presented in 
this report is limited and may change as new research emerges. 
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